en
AI Ranking
每月不到10元,就可以无限制地访问最好的AIbase。立即成为会员
Home
News
Daily Brief
Income Guide
Tutorial
Tools Directory
Product Library
en
AI Ranking
Search AI Products and News
Explore worldwide AI information, discover new AI opportunities
AI News
AI Tools
AI Cases
AI Tutorial
Type :
AI News
AI Tools
AI Cases
AI Tutorial
2024-08-28 09:34:17
.
AIbase
.
11.3k
The World's Fastest AI Inference Service Is Here! 20x Speed Increase at Extremely Low Cost
Cerebras Systems has launched Cerebras Inference, claiming it to be the fastest AI inference service in the world, achieving performance that surpasses traditional GPU-based systems by 20 times with significantly improved cost-effectiveness, particularly suitable for processing large language models (LLMs). Its 8B version processes 1800 tokens per second, while the 70B version processes 450 tokens, with speed and cost-performance far exceeding NVIDIA GPU solutions.